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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the 
fee set forth in 37 CFR 1 .17(e), was filed in this application after final rejection. 
Since this application is eligible for continued examination under 37 CFR 1.114, 
and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the 
previous Office action has been withdrawn pursuant to 37 CFR 1 .1 14. 
Applicant's submission filed on 08/05/2008 has been entered. 

Response to Amendment 

2. This action is responsive to the amendment and remarks received on 
04/29/2008. Claims 1—18 and 27 - 28 are currently pending. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this 
Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 

4. Claims 1 -6, 9, 1 1 -1 3, 1 5-1 8, and 27-28 are rejected under 35 

U.S.C. 102(b) as being anticipated by Sheehan et al. U.S. Patent No. 6,106,466. 
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With regards to claim 1 , Sheehan et al. teach an image processing 
system having a statistical appearance model for interpreting a 
digital image, the appearance model having at least one model 
parameter, the system comprising: a multi-dimensional first model 
object including an associated first statistical relationship and 
configured for deforming to approximate a shape and texture of a 
multi-dimensional target object in the digital image, (Sheehan et al., 
Column 12, Lines 8-11, Column 14 Lines 27 - 52) and a multi- 
dimensional second model object including an associated second 
statistical relationship and configured for deforming to approximate 
the shape and texture of the target object in the digital image, 
(Sheehan et al., Column 15 Lines 65 - Column 16 Line 25, and 
Column 12 Line 43 - Column 13 Line 24, "Each ventricular surface 
for the images comprising the training data is represented by an 
abstract three-dimensional triangular mesh... Triangles comprising 
the abstract mesh are subdivided recursively to produce a 
smoother final surface having approximately 576 triangular faces in 
the preferred embodiment") the second statistical relationship such 
that the difference represents at least one of an anatomical 
geometry for a different position in a patient anatomy represented 
by the digital image or a difference pathology; (Sheehan et al., 
Column 12 Line 43 - Column 13 Line 24 ,Sheehan et al. teach 
wherein the abstract three-dimensional triangular mesh is 
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comprised of multiple, 576, triangular faces each associated with 
anatomic landmarks, different regions i.e. different positions, of the 
patients left ventricle anatomical structure, Column 15 Lines 65 - 
Column 16 Line 25) a search module for applying the first model 
object to the image for generating a multi-dimensional first output 
object approximating the shape and texture of the target object and 
calculating a first error between the first output object and the target 
object, (Sheehan et al. Column 16 Lines 50 - 64) and for applying 
the second model object to the image for generating a multi- 
dimensional second output object approximating the shape and 
texture of the target object and calculating a second error between 
the second output object and the target object; (Sheehan et al., Fig. 
1 3, Column 1 6 Lines 50 - 64) a selection module for comparing the 
first error with the second error such that one of the output objects 
with the least significant error is selected; (Sheehan et al. Fig. 13 
Elements 238 & 244, Column 17 Lines 20 - 22) and an output 
module for providing data representing the selected output object to 
an output. (Sheehan et al. Fig. 1 Element 36, Column 17 Lines 41 - 
48) 

With regards to claim 2, Sheehan et al. teach the system according 
to claim 1 ; wherein the first model object is optimised for identifying 
a first one of the target object (Sheehan et al., Column 12 Lines 8 - 
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23) and the second model object is optimised for identifying a 
second one of the target object, (Sheehan et al., Column 1 6 Lines 
50 - 64) such that the second target object having an shape and 
texture configuration different from the first target object. (Sheehan 
et al., Column 16 Lines 50 - 64) 

With regards to claim 3, Sheehan et al. teach the system according 
to claim 2 further comprising the digital image being one of a set of 
digital images, (Sheehan et al. Column 1 1 Lines 29 - 24) wherein 
each of the model objects are configured for being applied by the 
search module to each of the digital images of the set. (Sheehan et 
al., Column 12 Lines 24-42) 

With regards to claim 4, Sheehan et al. teach the system according 
to claim 3, further comprising the selection module configured for 
selecting one of the object models to represent all the images in the 
set. (Sheehan et al. Column 13, Lines 3-6) 

With regards to claim 5, Sheehan et al. teach the system according 
to claim 1 ; wherein the output is selected from the group comprising 
an output file for storage in a memory and a user interface. 
(Sheehan et al. Fig. 2, Column 8 Lines 3-12 and Column 8 Line 
61 - Column 9 Line 3) 
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With regards to claim 6, Sheehan et al. teach the system according 
to claim 2 further comprising a training module configured for 
having a set of training images including a plurality of training 
objects with different appearance configurations, (Sheehan et al., 
Column 1 2 Lines 8 - 33) the training module for training the 
appearance model to have a plurality of the model objects 
optimised for identifying valid ranges of the shape and texture of 
respective ones of the target object. (Sheehan et al. Column 13 
Lines 55 - 65, Column 17 Lines5 - 13) 

With regards to claim 9, Sheehan et al. the system according to 
claim 2, wherein the first and second model objects represent 
different appearance configurations of the same anatomy of two 
different two dimensional slices taken from spaced apart locations 
of an image volume of the anatomy. (Sheehan et al., Column 1 1 
Lines 22 - 28, Column 15 Line 65 - Column 16 Line 25) 

With regards to claim 1 1 , Sheehan et al. teach the system 
according to claim 1 further comprising a predefined characteristic 
associated with the model parameter of the selected model object, 
(Sheehan et al., Column 12 Lines 8-61) the predefined 
characteristic for aiding a diagnosis of a patient having an anatomy 
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represented by the selected output object. (Sheehan et al. Column 
17 Lines 41 -48) 

With regards to claim 12, Sheehan et al. teach the system 
according to claim 1 1 , wherein the model parameter is partitioned 
in to a plurality of value regions, (Sheehan et al., Column 13 Line 
66 - Column 14 Line 26) each of the regions assigned one of a 
plurality of the predefined characteristics. (Sheehan et al. Column 
13 Lines 56-65) 

With regards to claim 13, Sheehan et al. teach the system 
according to claim 12, wherein the model parameter is selected 
from the group comprising a shape and texture parameter 
(Sheehan et al. Column 14 Lines 38 - 52), a scale parameter and a 
rotation parameter. (Sheehan et al., Column 14 Line 53 - Column 
15 Line 10) 

With regards to claim 15, Sheehan et al. teach the system 
according to claim 12, wherein the output module provides to the 
output the predefined characteristic assigned to the selected output 
object. (Sheehan et al. Column 17 Lines 41 - 47) 
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With regards to claim 16, Sheehan et al. teach the system 
according to claim 12 further comprising a training module 
configured for assigning the plurality of the predefined 
characteristics to the model parameter. (Sheehan et al. Column 12 
Lines 43-61) 

With regards to claim 17, Sheehan et al. teach the system 
according to claim 15 further comprising a confirmation module for 
determining if the value of the model parameter assigned to the 
selected output object is within one of the partitioned regions. 
(Sheehan et al. Column 16 Lines 50 - 64) 

With regards to claim 18, Sheehan et al. teach the system 
according to claim 17, wherein the value of the model parameter 
when outside of all the partitioned value regions indicates the first 
output object is an invalid approximation of the target object. 
(Sheehan et al. Column 17 Lines 3-13) 

With regards to claim 27, Sheehan et al. teach a method for 
interpreting a digital image with a statistical appearance model, the 
appearance model having at least one model parameter, the 
method comprising the steps of: providing a multi-dimensional first 
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model object including an associated first statistical relationship and 
configured for deforming to approximate a shape and texture of a 
multi-dimensional target object in the digital image; (Sheehan et al., 
Column 1 2, Lines 8-11, Column 14 Lines 27 - 52) providing a 
multi-dimensional second model object including an associated 
second statistical relationship and configured for deforming to 
approximate the shape and texture of the target object in the digital 
image, (Sheehan et al., Column 15 Lines 65 - Column 16 Line 25) 
the second model object having a shape and texture configuration 
different from the first model object; (Sheehan et al., Column 15 
Lines 65 - Column 16 Line 25) applying the first model object to the 
image for generating a multi-dimensional first output object 
approximating the shape and texture of the target object; (Sheehan 
et al. Column 16 Lines 50 - 64) calculating a first error between the 
first output object and the target object; (Sheehan et al. Column 16 
Lines 50 - 64) applying the second model object to the image for 
generating a multi-dimensional second output object approximating 
the shape and texture of the target object; (Sheehan et al., Fig. 13, 
Column 16 Lines 50 - 64) calculating a second error between the 
second output object and the target object; (Sheehan et al., Fig. 13, 
Column 1 6 Lines 50 - 64) comparing the first error with the second 
error such that one of the output objects with the least significant 
error is selected; (Sheehan et al. Fig. 13 Elements 238 & 244, 



Application/Control Number: 10/767,727 Page 10 

Art Unit: 2624 

Column 17 Lines 20-22) and providing data representing the 
selected output object to an output. (Sheehan et al. Fig. 1 Element 
36, Column 17 Lines 41 - 48) 

With regards to claim 28, Sheehan et al. teach a computer program 
product for interpreting a digital image using a statistical 
appearance model, the appearance model having at least one 
model parameter, the computer program product comprising: a 
computer readable medium; (Sheehan et al. Column 8 Lines 3 - 
15, Column 8 Line 61 - Column 9 Line 10) an object module stored 
on the computer readable medium configured for having a multi- 
dimensional first model object including an associated first 
statistical relationship and configured for deforming to approximate 
a shape and texture of a multi-dimensional I target object in the 
digital image, (Sheehan et al., Column 1 2, Lines 8-11, Column 
14 Lines 27 - 52) and a multi-dimensional second model object 
including an associated second statistical relationship and 
configured for deforming to approximate the shape and texture of 
the target object in the digital image; (Sheehan et al., Column 15 
Lines 65 - Column 16 Line 25) a search module stored on the 
computer readable medium for applying the first model object to the 
image for generating a multi-dimensional first output object 
approximating the shape and texture of the target object and 
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calculating a first error between the first output object and the target 
object, (Sheehan et al. Column 16 Lines 50 - 64) and for applying 
the second model object to the image for generating a multi- 
dimensional second output object approximating the shape and 
texture of the target object and calculating a second error between 
the second output object and the target object, (Sheehan et al., Fig. 
1 3, Column 1 6 Lines 50 - 64) the second model object having a 
shape and texture configuration different from the first model object; 
(Sheehan et al., Column 15 Lines 65 -Column 16 Line 25) a 
selection module coupled to the search module for comparing the 
first error with the second error such that one of the output objects 
with the least significant error is selected; (Sheehan et al. Fig. 13 
Elements 238 & 244, Column 17 Lines 20 - 22) and an output 
module coupled to the selection module for providing data 
representing the selected output object to an output. (Sheehan et 
al. Fig. 1 Element 36, Column 17 Lines 41 - 48) 



Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 1 02 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



Application/Control Number: 10/767,727 Page 
Art Unit: 2624 

6. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 
148 USPQ 459 (1966), that are applied for establishing a background for 
determining obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at 
issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

7. Claims 7-8, 10, and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sheehan et al. U.S. Patent No. 6,1 06,466 in view of Steven C. 
Mitchell, Boudewijn P.F. Lelieveldt, Hans G. Bosch, Johan H.C. Reiber, and 
Milan Sonka, "Disease Characterization of Active Appearance Model 
Coefficients", MEDICAL IMAGING 2003.IMAGE PROCESSING 17-20 FEB. 2003 
SAN DIEGO, CA, USA, vol. 5032, 17 February 2003(2003-02-17), pages 949- 
957, Proceedings of the SPIE - The International Society for Optical Engineering 
SPIE-lnt. Soc. Opt. Eng USA. 

With regards to claim 7, Sheehan et al. teach the system according 
to claim 2. Sheehan et al. fail to teach wherein the appearance 
model is an active appearance model. Mitchell et al. teach wherein 
the appearance model is an active appearance model. (Mitchell et 
al., Section 1 Paragraph 2 - Paragraph 3) It would have been 
obvious to one of ordinary skill in the art at the time of the invention 
to modify the system of Sheehan et al. with the teachings of 
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Mitchell et al. This modification would have been prompted 
because Active appearance models allow for the expected size, 
shape, and appearance variations in objects of interest. 

With regards to claim 8, Sheehan et al. teach the system according 
to claim 2. Sheehan et al. fail to teach wherein the first and second 
model objects represent different pathology types of patient 
anatomy. Mitchell et al. teach wherein the first and second model 
objects represent different pathology types of anatomy. (Mitchell et 
al. Section 1 .1 ) It would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify the system of 
Sheehan et al. with the teachings of Mitchell et al. This modification 
would have been prompted because Sheehan et al. suggest using 
their invention for a "plurality of three-dimensional reconstructions 
of the left ventricles in a population of hearts exhibiting a wide 
variety of types and severity of heart disease..." (Sheehan et al. 
Column 1 2 Lines 8 - 23) This modification would allow for the user 
to more quickly diagnose patients accurately. 

With regards to claim 10, Sheehan et al. as modified teach the 
system wherein the two different pathology types are represented 
by two different training objects in a set of training images since the 
two different pathology types in the device of Mitchell et al. are 
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represented by two different training objects in a set of training 
images. (Mitchell et al., Section 1.1 Paragraph 1 and Section 3 
Paragraph 1) 

With regards to claim 14, Sheehan et al. teach the system 
according to claim 12. Sheehan et al. fail to teach wherein at least 
two of the predefined characteristics represent different pathology 
types of the anatomy. Mitchell et al. teach wherein at least two of 
the predefined characteristics represent different pathology types of 
the anatomy. (Mitchell et al. Section 1 .1 Paragraph 1) It would have 
been obvious to one of ordinary skill in the art at the time of the 
invention to modify the system of Sheehan et al. with the teachings 
of Mitchell et al. This modification would have been prompted in 
order to allow for weights to be applied to these characteristics, 
which would therefore help a user more accurately diagnose 
patients quickly, accurately, and effectively with the aid of the 
systems. 



Response to Arguments 

8. Applicant's arguments filed 4/29/2008 have been fully considered but they 
are not persuasive. 
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On page 12 lines 6 - 12 of the remarks, the Applicant's 

Representative argues that Sheehan et al. describe how to build a single 

model and optimize that model which is different than the claimed 

invention which requires at least two different statistical models for 

segmenting a single image based on different geometrical and/or 

pathological considerations. The Examiner respectfully disagrees. The 

claims are interpreted in their broadest reasonable interpretation. Sheehan 

et al. describe iteratively adjusting a mesh model to optimize that model to 

fit a patient's anatomical structure, Sheehan et al. use the left ventricle for 

purposes of explanation but in Column 9 Lines 22 - 35 disclose that their 

method/system may be employed on other anatomical structures (right 

ventricle). The Examiner asserts that once the mesh model of Sheehan et 

al. which is based upon a archetype model is updated/optimized the 

model becomes a second, different model, since some of the properties of 

the model are adjusted. Furthermore, the Examiner cites Column 12 Line 

43 - Column 13 Line 19 of Sheehan et al. to bring Applicant's 

Representative's attention to the fact that Sheehan et al. describe a 

plurality of triangular meshes each of which is associated with a specific 

region/geometry/position of a patients anatomical structure. Each of these 

subdivided three-dimensional triangular meshes of Sheehan et al. are 

adjusted independently to fit their associated region on the ventricular 

surface. The mesh models therefor read on at least one model and at 

least a second different model wherein the statistical relationship of each 
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model is different and are associated with different positions of a patient's 
anatomy. 

On page 12 lines 14-22 of the remarks, the Applicant's 
Representative argues that Sheehan et al. only defines one model, an 
archetype shape with corresponding covariance matrix. The Applicant's 
Representative argues that this single model is different that the 
Applicant's claimed invention. The Examiner respectfully disagrees. The 
Examiner asserts that the Archetype model of Sheehan et al. and the 
covariance matrix of Sheehan et al. are used to construct a plurality of 
triangular three-dimensional mesh models which are relied on to constitute 
a first and second model as required in the claimed limitation. 

Conclusion 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to ERIC RUSH whose telephone number is 
(571)270-3017. The examiner can normally be reached on 7:30AM - 5:00PM 
(EST). 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Samir Ahmed can be reached on (571) 272-7413. The 
fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

ER 



/Samir A. Ahmed/ 

Supervisory Patent Examiner, Art Unit 2624 



